Method and device for encoding/decoding video signals using base layer

ABSTRACT

The present invention relates to encoding and decoding a video signal by motion compensated temporal filtering. In one embodiment, a first sequence of frames are decoded by inverse motion compensated temporal filtering by selectively adding to a first image block in the first sequence image information, the image information being based on at least one of (1) a second image block from the first sequence and (2) a third image block from an auxiliary sequence of frames.

DOMESTIC PRIORITY INFORMATION

This application claims priority under 35 U.S.C. §120 on U.S.application Ser. No. 13/067,497, filed Jun. 6, 2011 which claimspriority on U.S. application Ser. No. 11/231,868, filed Sep. 22, 2005,which claims priority under 35 U.S.C. §119 on U.S. ProvisionalApplication Ser. No. 60/612,180, filed Sep. 23, 2004; the entirecontents of each of which are hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method and a device for encoding anddecoding video signals.

2. Description of the Related Art

A number of standards have been suggested for compressing video signals.One well-known standard is MPEG, which has been adopted as a standardfor recording movie content, etc., on a recording medium such as a DVDand is now in widespread use. Another well-known standard is H.264,which is expected to be used as a standard for high-quality TV broadcastsignals in the future.

While TV broadcast signals require high bandwidth, it is difficult toallocate such high bandwidth for the type of wirelesstransmissions/receptions performed by mobile phones and notebookcomputers, for example. Thus, video compression standards for suchdevices must have high video signal compression efficiencies.

Such mobile devices have a variety of processing and so that a varietyof forms corresponding to a variety of combinations of variables such asthe number of frames transmitted per second, resolution, the number ofbits per pixel, etc. This imposes a great burden on content providers.

In view of the above, content providers prepare high-bitrate compressedvideo signals for each video source and perform, when receiving arequest from a mobile device, a process of decoding the compressed videosignals and encoding it back into video signals suited to the videoprocessing capabilities of a mobile device before providing therequested video signals to the mobile device. However, this methodentails a transcoding procedure including decoding, scaling and encodingprocesses, and causes some time delay in providing the requested signalsto the mobile device. The transcoding procedure also requires complexhardware and algorithms to cope with the wide variety of target encodingformats.

A Scalable Video Codec (SVC) has been developed in an attempt toovercome these problems. In this scheme, video signals are encoded intoa sequence of pictures with the highest image quality while ensuringthat a part of the encoded picture sequence (specifically, a partialsequence of pictures intermittently selected from the total sequence ofpictures) can be used to represent the video signals with a low imagequality.

Motion Compensated Temporal Filtering (MCTF) is an encoding and decodingscheme that has been suggested for use in the scalable video codec.However, the MCTF scheme requires a high compression efficiency (i.e., ahigh coding rate) for reducing the number of bits transmitted per secondsince it is highly likely to be applied to mobile communication wherebandwidth is limited, as described above.

Although it is possible to represent low image-quality video signals byreceiving and processing part of the sequence of pictures encoded in thescalable MCTF coding scheme as described above, there is still a problemin that the image quality is significantly reduced when the bitrate islowered.

SUMMARY OF THE INVENTION

Therefore, the present invention has been made in view of the aboveproblems, and it is an object of the present invention to provide amethod and a device for encoding video signals in a scalable scheme byadditionally using a base layer provided for a lower transfer rate.

The present invention related to encoding and decoding a video signal bymotion compensated temporal filtering.

In one embodiment, a first sequence of frames are decoded by inversemotion compensated temporal filtering by selectively adding to a firstimage block in the first sequence image information, the imageinformation being based on at least one of (1) a second image block fromthe first sequence and (2) a third image block from an auxiliarysequence of frames.

In another embodiment, a frame in a current frame interval is decodedwherein the second image block is in a frame of the first sequence thatis one of prior to and subsequent to a frame including the first imageblock.

In another embodiment, a frame in a current interval is decoded whereinthe third image block is from a frame in the auxiliary sequence offrames that is temporally aligned with a frame including the first imageblock.

In another embodiment, a frame in a current frame interval is decoded byadding the first image block one of (1) an adjacent image blockpositioned prior to the first image block or an adjacent imagepositioned subsequent to the first image block in the first sequence,and (2) the third image block from the auxiliary sequence of frames fromat least one of an image block temporally aligned with, before and afteran image block in the auxiliary sequence temporally aligned with thefirst image block.

In another embodiment, a frame in a current frame interval is decoded byadding the first image block two of (1) an adjacent image blockpositioned prior to the first image block or an adjacent imagepositioned subsequent to the first image block in the first sequence,and (2) the third image block from the auxiliary sequence of frames fromat least one of an image block temporally aligned with, before and afteran image block in the auxiliary sequence temporally aligned with thefirst image block.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and other advantages of thepresent invention will be more clearly understood from the followingdetailed description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a block diagram of a video signal encoding device to which avideo signal compression method according to the present invention isapplied;

FIG. 2 is a block diagram of a filter that performs imageestimation/prediction and update operations in the MCTF encoder as shownin FIG. 1;

FIG. 3 illustrates how L frames and H frames having image differencesare produced from a picture sequence in a group of pictures (GOP)according to an embodiment of the present invention;

FIG. 4 illustrates the structure of timing information according to anembodiment of the present invention, which indicates a temporalcorrelation between main frames of an enhanced layer and auxiliaryframes of a base layer and which is inserted and transmitted in abitstream of the enhanced layer;

FIGS. 5 a and 5 b illustrate the relationship between frames of theenhanced and the base layers which can be used as references to producean H frame having a predicted image according to an embodiment of thepresent invention;

FIG. 6 illustrates limited examples of various reference block selectionmodes of a macroblock produced by the filter of FIG. 2;

FIG. 7 illustrates the structure of reference block selection modeinformation carried in macroblock header information according to anembodiment of the present invention;

FIG. 8 illustrates the structure of information required due to the useof the base layer, which is carried in the enhanced layer bitstream,according to an embodiment of the present invention;

FIG. 9 illustrates the structure of information of the encoding level ofL frames of the enhanced layer from which images of auxiliary frames ofthe base layer have been subtracted;

FIG. 10 is a block diagram of a device for decoding a bitstream encodedby the device of FIG. 1; and

FIG. 11 is a block diagram of an inverse filter that performs inverseprediction and update operations in an MCTF decoder shown in FIG. 10.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Example embodiments of the present invention will now be described indetail with reference to the accompanying drawings.

FIG. 1 is a block diagram of a video signal encoding device to which ascalable video signal compression method according to the presentinvention is applied.

The video signal encoding device shown in FIG. 1 comprises an MCTFencoder 100, a texture coding unit 110, a motion coding unit 120, a baselayer encoder 150, and a muxer (or multiplexer) 130. The MCTF encoder100 encodes an input video signal in units of macroblocks in an MCTFscheme, and generates suitable management information. The texturecoding unit 110 converts information of encoded macroblocks into acompressed bitstream. The motion coding unit 120 encodes motion vectorsof macroblocks obtained by the MCTF encoder 100 into a compressedbitstream according to a specified scheme. The base layer encoder 150encodes an input video signal according to a specified scheme, forexample, according to the MPEG-1, 2 or 4 standard or the H.261, H.263 orH.264 standard, and may produce a small-screen picture sequence, forexample, a sequence of pictures scaled down to 25% of their originalsize if necessary. The muxer 130 encapsulates output data from thetexture coding unit 110, the small-screen picture sequence output fromthe base layer encoder 150, and motion vector data of the motion codingunit 120 into a predetermined format. The muxer 130 then multiplexes andoutputs the encapsulated data into a set transmission format.

In the following description, the small-screen picture sequence isreferred to as a base layer sequence, and the output frame/picturesequence of the MCTF encoder 100 is referred to as an enhanced layersequence. The base layer sequence is a sequence of auxiliary frames thatis provided to be selectively used in devices that may have lowerperformance capabilities than the capabilities of other devices thatdecode a sequence of main frames of the enhanced layer.

The MCTF encoder 100 performs motion estimation and predictionoperations on each target macroblock in a frame. The MCTF encoder 100also performs an update operation in which an image difference of thetarget macroblock from a corresponding macroblock in a neighbor frame isadded to the corresponding macroblock in the neighbor frame. FIG. 2 is ablock diagram of a filter for carrying out these operations.

As shown in FIG. 2, the filter includes a splitter 101, anestimator/predictor 102, an updater 103, and a decoder 105. The splitter101 splits an input video frame sequence into earlier and later framesin pairs of successive frames (for example, into odd and even frames).The decoder 105 decodes the sequence of encoded small-screen picturesreceived from the base layer encoder 150, and reconstructs pictures tohave their original size using an internal scaler 105 a. Theestimator/predictor 102 performs motion estimation and prediction oneach macroblock in the current frame that will be converted to apredicted frame. Specifically, the estimator/predictor 102 searches fora reference block of each macroblock in the current frame in neighborframes of the enhanced layer prior to or subsequent to the current frameor in frames of the base layer, whose size have been restored by thescaler 105 a. The estimator/predictor 102 then calculates an imagedifference (i.e., a pixel-to-pixel difference) of each macroblock in thecurrent frame from the reference block in the neighbor frames of theenhanced layer and a motion vector from each macroblock to the referenceblock therein. Alternatively, the estimator/predictor 102 calculates animage difference of each macroblock in the current frame from acorresponding macroblock in a base layer frame in the same time as thecurrent frame, whose size has been restored by the scaler 105 a. Theupdater 103 performs an update operation on a macroblock, whosereference block has been found by the motion estimation, by normalizingthe calculated image difference of the macroblock from the referenceblock and adding the normalized value to the reference block. Here, thescaler 105 a may be provided as a separate unit outside the decoder 105.The operation carried out by the updater 103 is referred to as a ‘U’operation, and a frame produced by the ‘U’ operation is referred to asan ‘L’ (“low”) frame. The updater 103 selectively performs an operationfor subtracting an enlarged base layer frame in the same time as theupdated frame from the updated frame, and outputting a corresponding Lframe produced by the subtraction.

The filter of FIG. 2 may perform its operations on a plurality of slicessimultaneously and in parallel, which are produced by dividing a singleframe, instead of performing its operations on the video frame. A frame(or slice) having an image difference, which is produced by theestimator/predictor 102, is referred to as an ‘H’ (“high”) frame (orslice) since the difference value data in the ‘H’ frame (or slice)reflects high frequency components of the video signal. In the followingdescription of the embodiments, the term ‘frame’ is used in a broadsense to include a ‘slice’.

The estimator/predictor 102 divides each of the input video frames intomacroblocks of a set size. For each divided macroblock, theestimator/predictor 102 searches for a block, whose image is mostsimilar to that of each divided macroblock, in previous/next neighborframes of the enhanced layer and/or in corresponding base layer framesenlarged by the scaler 105 a. That is, the estimator/predictor 102searches for a macroblock temporally correlated with each dividedmacroblock. A block having the most similar image to a target imageblock has the smallest image difference from the target image block. Theimage difference of two image blocks is defined, for example, as the sumor average of pixel-to-pixel differences of the two image blocks.Accordingly, of macroblocks in a previous/next neighbor frame and/or ina corresponding frame enlarged by the scaler 105 a which have apredetermined threshold pixel-to-pixel difference sum (or average) orless from a target macroblock in the current frame, a macroblock havingthe smallest difference sum (or average) (i.e., the smallest imagedifference) from the target macroblock is referred to as a referenceblock. For each macroblock of a current frame, two reference blocks maybe present in a frame (including a base layer frame) prior to thecurrent frame and in a frame (including a base layer frame) subsequentthereto.

If the reference block is found, the estimator/predictor 102 calculatesand outputs a motion vector from the current block to the referenceblock, and also calculates and outputs pixel error values (i.e., pixeldifference values) of the current block from pixel values of thereference block, which is present in either the prior frame or thesubsequent frame, or from average pixel values of the two referenceblocks, which are present in the prior and subsequent frames.

If no macroblock providing a predetermined threshold image difference orless from the current macroblock is found in the two neighbor frames(including base layer frames) via the motion estimation operation, theestimator/predictor 102 determines whether or not a frame in the sametime as the current frame (hereinafter also referred to as a “temporallycoincident frame”) or a frame in a close time to the current frame(hereinafter also referred to as a “temporally close frame”) is presentin the base layer sequence. If such a frame is present in the base layersequence, the estimator/predictor 102 obtains the image difference ofthe current macroblock from a corresponding macroblock in the temporallycoincident or temporally close frame based on pixel values of the twomacroblocks, and does not obtain a motion vector of the currentmacroblock. A close time to the current frame corresponds to a timeinterval including frames that can be regarded as having the same imageas the current frame. Information of this time interval is carriedwithin an encoded stream, which will be described later.

The corresponding macroblock in the same or close time in the base layermay be used even when a reference block is found for the currentmacroblock. Specifically, the pixel value differences of the currentmacroblock can be calculated, based on, for example the average pixelvalues of the found reference macroblock and the corresponding baselayer macroblock. In this case, a motion vector is determined for thecurrent macroblock whose reference block is found, and informationindicating that a base layer frame has been used is recorded in a headerof the current macroblock.

Such an operation of the estimator/predictor 102 is referred to as a ‘P’operation.

The MCTF encoder 100 generates a sequence of H frames and a sequence ofL frames, respectively, by performing the ‘P’ and ‘U’ operationsdescribed above on a certain-length sequence of pictures, for example,on a group of pictures (GOP). Then, an estimator/predictor and anupdater at a next temporal decomposition stage (not shown) generates asequence of H frames and a sequence of L frames by repeating the ‘P’ and‘U’ operations on the generated L frame sequence. The ‘P’ and ‘U’operations are performed an appropriate number of times to produce afinal enhanced layer sequence.

FIG. 3 shows an example of such a procedure in which the ‘P’ and ‘U’operations are performed three times (i.e., up to a 3rd encoding level)on one GOP until two L frames remain. In the example of FIG. 3, theupdater 103 in the MCTF encoder 100 generates a 2nd-level sequence of Lframes from a 1st-level sequence of L frames by subtracting a sequenceof temporally-coincident enlarged frames received from the scaler 105 afrom the 1st-level sequence of L frames. It is also possible to generatea next-level sequence of L frames by subtracting thetemporally-coincident enlarged frames from L frames of a level otherthan the 1st level. For example, in the case where enlarged base-layerpictures provided from the scaler 105 a are not synchronized with1st-level L frames, the level of a sequence of L frames from which thebase layer pictures will be subtracted is increased to reduce the timedifference of the video signals of the two layers, and the enlargedbase-layer pictures are subtracted from the L frames of the increasedlevel.

If an enhanced layer sequence is produced by subtracting a sequence ofsmall-screen frames provided in the base layer from a sequence of Lframes of an appropriate level as described above, image redundancy isremoved from the enhanced layer sequence, thereby reducing the amount ofcoded data and increasing coding gain.

While performing scalable encoding in the above manner, the MCTF encoder100 incorporates timing information, which has a structure as shown inFIG. 4. The timing information is used for synchronizing the enhancedlayer to the base layer into a bitstream of the enhanced layer. The MCTFencoder 100 receives information required to provide timing information,as shown in FIG. 4, from the base layer encoder 150 and/or obtains therequired information from externally input and set values. The timinginformation of FIG. 4 is inserted and transmitted in a bitstream of theenhanced layer periodically or once at the initial transmission of thebitstream.

In the timing information structure of FIG. 4, a field‘flag_BL_fixed_frame_rate’ contains information indicating whether ornot the base layer bitstream is encoded at a fixed frame rate in thebase layer encoder 150. A field ‘BL_time_increment_resolution’ containsinformation representing the ‘resolution’ of a time value recorded in afield ‘BL_time_increment’. For example, if ‘1’ (second) is recorded inthe field ‘BL_time_increment’ and ‘5’ is recorded in the field‘BL_time_increment_resolution’, this indicates that base layer framesare transmitted at 5 frames per second. A field‘THR_temporal_coincident’ indicates the time interval between anenhanced layer frame and a base layer frame that are regarded as havingthe same time. For example, this field may have a value in milliseconds.Specifically, when this value is 10, the decoder regards both anenhanced layer frame and a base layer frame as having the same image(i.e., as being coincident) if the difference between a time value ofthe enhanced layer frame, which is inserted in the frame duringencoding, and a time value of the base layer frame calculated from theframe rate (where the frame rate=the number of received base layerframes*‘BL_time_increment’/‘BL_time_increment_resolution’) is less than0.01 second.

When the estimator/predictor 102 performs the ‘P’ operation to producean H frame, i.e., when it searches for a reference block of eachmacroblock in the current frame and converts each macroblock to apredicted image block, the estimator/predictor 102 can selectively useenlarged pictures of the base layer received from the scaler 105 a, inaddition to neighbor L frames of the enhanced layer prior to andsubsequent to the current frame, as shown in FIG. 5 a.

In an example embodiment of the present invention, five frames are usedto produce each H frame. FIG. 5 b shows five frames that can be used toproduce an H frame. Specifically, L frames 401 and 402 are in the sameMCTF level as a current L frame 400L and respectively positioned priorto and subsequent to the L frame 400L. A frame 405 of the base layer isin the same time as the L frame 400L. Frames 403 and 405 respectivelypositioned, prior to and subsequent to the frame 404, are used toproduce an H frame 400H from the current L frame 400L.

FIG. 6 shows some examples of reference block selection modes accordingto an example embodiment of the present invention in which one or twoare selected from five frames to convert a macroblock to imagedifference data. In FIG. 6, ‘Fwd_BL_mode’ denotes a reference blockselection mode which uses a reference block present in a past picture inthe base layer sequence. ‘Bwd_BL_mode’ denotes a reference blockselection mode which uses a reference block present in a future picturein the base layer sequence. ‘Bid_BL_mode’ denotes a reference blockselection mode which uses two reference blocks present in a past pictureand in a future picture in the base layer sequence. ‘Fwd_BL_Bwd_EL_mode’denotes a reference block selection mode which uses two reference blockspresent in a past picture in the base layer and in a future picture inthe enhanced layer. ‘Fwd_EL_Bwd_BL_mode’ denotes a reference blockselection mode which uses two reference blocks present in a past picturein the enhanced layer and in a future picture in the base layer. Inaddition, ‘TC_pred_mode’ denotes a reference block selection mode whichuses pixel values of a corresponding block in a picture in the baselayer in the same time as the current frame. ‘TC_pred_Bwd_BL_mode’denotes a reference block selection mode which uses a correspondingblock in a picture in the base layer in the same time as the currentframe and a reference block present in a future picture in the baselayer. ‘TC_pred_Fwd_BL_mode’ denotes a reference block selection modewhich uses a corresponding block in a picture in the base layer in thesame time as the current frame and a reference block present in a pastpicture in the base layer. ‘TC_pred_Bwd_EL_mode’ denotes a referenceblock selection mode which uses a corresponding block in a picture inthe base layer in the same time as the current frame and a referenceblock present in a future picture in the enhanced layer.‘TC_pred_Fwd_EL_mode’ denotes a reference block selection mode whichuses a corresponding block in a picture in the base layer in the sametime as the current frame and a reference block present in a pastpicture in the enhanced layer.

There are various other modes not shown in FIG. 6. To inform the decoderof which one of the modes shown in FIG. 6 and the various other modesnot shown therein is employed, the MCTF encoder 100 transmits ‘referenceblock selection mode’ information having a structure as shown in FIG. 7to the texture coding unit 110 after inserting/writing it into a“Ref_Sel_mode” field at a specified position of a header area of acorresponding macroblock as shown in FIG. 8. The “Ref_Sel_mode” fieldcan be inserted in the header of a frame (or slice) so that the same tworeference pictures can be used in the same frame (or slice).

In the reference block selection mode information structure of FIG. 7,‘flag_use_BL’ denotes information indicating whether or not the baselayer is used for the reference block, and ‘reference_selection_code’denotes a field in which a value about one of the above-mentioned modesis written. The value in the field ‘reference_selection_code’ indicateswhich one or two of the five frames described above are used to producethe image difference of the current macroblock.

The MCTF encoder 100 also transmits information of the level (i.e., MCTFlevel) of an L frame sequence, from which the base layer picturesequence has been subtracted, after writing the level information havinga structure, as shown in FIG. 9, into a BL_subtraction field at aspecified position of a header area of the corresponding GOP as shown inFIG. 8.

In the information structure shown in FIG. 9, ‘flag_use_BL’ denotesinformation indicating whether or not the base layer is used for thecorresponding GOP, and ‘BL_subtraction_level’ denotes informationindicating the level of an L frame sequence from which the base layerpicture sequence has been subtracted.

The data stream encoded in the method described above is transmitted bywire or as a wireless transmission to a decoding device. Alternatively,it may be delivered via recording media. The decoding device restoresthe original video signal in the enhanced and/or base layer according tothe method described below.

FIG. 10 is a block diagram of a device for decoding a data streamencoded by the device of FIG. 1. The decoding device of FIG. 10 includesa demuxer (or demultiplexer) 200, a texture decoding unit 210, a motiondecoding unit 220, an MCTF decoder 230, and a base layer decoder 240.The demuxer 200 separates a received data stream into a compressedmotion vector stream, a compressed macroblock information stream, and abase layer stream. The texture decoding unit 210 decodes the compressedbitstream. The motion decoding unit 220 decodes the compressed motionvector information. The MCTF decoder 230 decodes the bitstreamcontaining macroblock information and the motion vector in an MCTFscheme. The base layer decoder 240 decodes the base layer streamaccording to a specified scheme, for example, according to the MPEG-4 orH.264 standard. The base layer decoder 240 includes therein a scaler 240a that enlarges a small-screen picture sequence in the base layer to theenhanced layer picture size. The scaler 240 a may be provided as aseparate unit outside the base layer decoder 240.

The MCTF decoder 230 includes, as an internal element, an inverse filterthat has a structure as shown in FIG. 11 for decoding an input bitstreaminto a frame sequence.

The inverse filter of FIG. 11 includes a front processor 236, an inverseupdater 231, an inverse predictor 232, a motion vector decoder 235, andan arranger 234. The front processor 236 divides an input enhanced layerstream into H frames and L frames, and analyzes information in eachheader in the enhanced layer stream. The inverse updater 231 subtractspixel difference values of input H frames from corresponding pixelvalues of input L frames. The inverse predictor 232 restores input Hframes to frames having original images with reference to the L frames,from which the image differences of the H frames have been subtracted,and/or with reference to enlarged pictures output from the scaler 240 a.The motion vector decoder 235 decodes an input motion vector stream intomotion vector information of each block and provides the motion vectorinformation to the inverse predictor 232. The arranger 234 interleavesthe frames completed by the inverse predictor 232 between the L framesoutput from the inverse updater 231, thereby producing a normal videoframe sequence.

Although one inverse updater 231 and one inverse predictor 232 areillustrated above, the inverse updaters 231 and the inverse predictors232 are provided in multiple stages corresponding to the MCTF encodinglevels described above. As denoted by “239” in FIG. 11, image values ofenlarged pictures from the scaler 240 a are added to corresponding imagevalues of L frames output from an inverse updater 231 of one of themultiple stages. Based on the value of the information “BL subtractionlevel” shown in FIG. 9 carried within the enhanced layer stream, theMCTF decoder 230 determines the stage (encoding level) of L frames towhich the base layer frames are to be added.

The front processor 236 analyzes and divides an input enhanced layerstream into an L frame sequence and an H frame sequence. In addition,the front processor 236 uses information in each header in the enhancedlayer stream to notify the inverse predictor 232 of which frame orframes have been used to produce macroblocks in the H frame. The usedframe or frames can be determined from received ‘reference selectioncode’ information as shown in FIG. 7.

For each macroblock of an H frame, the inverse predictor 232 may specifyan L frame in the enhanced layer and/or an enlarged frame in the baselayer used to produce a predicted image of the macroblock of the Hframe, and determine a reference block in the specified frame(s) basedon a motion vector provided from the motion vector decoder 235, and thenadd pixel values of the reference block or average pixel values of thetwo reference blocks to pixel difference values of the macroblock of theH frame, thereby restoring the original image of the macroblock thereof.In the case of using a base layer frame, the inverse predictor 232refers to timing information shown in FIG. 4 analyzed by the frontprocessor 236 to specify an auxiliary frame in the base layer prior to,subsequent to, or temporally coincident with the current H frame. Ifoutput frames of the base layer decoder 240 are counted, it is possibleto determine the time of each base layer frame from the informationshown in FIG. 4, so that it is possible to determine whether the baselayer frame is prior to or subsequent to the current H frame. Whether ornot each base layer frame is in the same time as the current H frame isdetermined based on both the time difference between the two frames andthe value ‘THR_temporal_coincident’.

For one H frame, the MCTF decoding is performed in specified units, forexample, in units of slices in a parallel fashion, so that allmacroblocks in the frame approximately restore their original images,and the original images are combined to constitute a complete videoframe.

The above decoding method restores an MCTF-encoded data stream to acomplete video frame sequence. In the case where theestimation/prediction and update operations have been performed for aGOP N times in the MCTF encoding procedure described above, a videoframe sequence with the original image quality is obtained if theinverse prediction and update operations are performed N times, whereasa video frame sequence with a lower image quality and at a lower bitrateis obtained if the inverse prediction and update operations areperformed less than N times. However, it is possible to achieve a higherimage quality by decoding and outputting a frame sequence in the baselayer, instead of obtaining a low bitrate video frame sequence accordingto the MCTF scheme. Accordingly, the decoding device is designed toperform inverse prediction and update operations to the extent suitablefor its performance or is designed to decode only the base layerstreams.

The decoding device described above can be incorporated into a mobilecommunication terminal or the like or into a recording media playbackdevice.

As is apparent from the above description, a method and device forencoding/decoding video signals according to the present invention hasadvantages in that a base layer provided for low-performance decoders,in addition to an enhanced layer, is used in an MCTF encoding procedureto produce H and L frames, thereby reducing the total amount of codeddata and thus improving the MCTF coding efficiency.

Although this invention has been described with reference to thepreferred embodiments, it will be apparent to those skilled in the artthat various improvements, modifications, replacements, and additionscan be made in the invention without departing from the scope and spiritof the invention. Thus, it is intended that the invention cover theimprovements, modifications, replacements, and additions of theinvention, provided they come within the scope of the appended claimsand their equivalents.

1-3. (canceled)
 4. A method of decoding a video signal, comprising:separating a base layer stream and an enhanced layer stream from thevideo signal; obtaining prediction information indicating whetherinter-layer prediction is used for a current block in an enhanced layer,the inter-layer prediction is to predict the current block by using abase layer; obtaining macroblock information of the current block usingthe enhanced layer stream; obtaining motion prediction information usingthe macroblock information, the motion prediction information indicatingwhether motion information of the current block is obtained using motioninformation of a reference block; obtaining motion information of thecurrent block using the motion prediction information; and decoding thecurrent block by using the motion information of the current block. 5.The method of claim 1, wherein the reference block is a block of thebase layer having the smallest image difference from the current block.6. The method of claim 1, wherein the reference information comprises amotion vector between the current block and the reference block.